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We analyse the non-equilibrium distribution in dissipative dynamical systems at finite noise in- 
tensities. The effect of finite noise is described in terms of topological changes in the pattern of 
optimal paths. Theoretical predictions are in good agreement with the results of numerical solution 
of the Fokker-Planck equation and Monte Carlo simulations. 
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The analysis of the probability distribution in systems 
away from thermal equilibrium is one of the main themes 
in statistical physics 0, which has recently attracted 
renewed interest in the context of stochastic resonance 
and stochastic ratchets Despite its importance, the 
theory of the probability distributions in non-equilibrium 
systems is still in its infancy. 

One of the keys to the solution of this problem is an 
understanding of how a non-equilibrium system deviates 
far away from a steady state 0. The probability of 
such deviations is small and can be approximated by a 
Boltzmann-like distribution of the form 

p(x) = z{x) exp (S(x)/e) , e -> 0. (1) 

Here the action function S(x) plays the role of a non- 
equilibrium potential 0, z(x) is a prefactor and e is the 
noise intensity. The majority of earlier studies have been 
restricted to the analysis of zero noise limit. In this limit 
properties of p(x) are determined by the properties of 
optimal paths that are deterministic trajectories along 
which the system moves in the course of large devia- 
tions . Accordingly, the pattern of optimal paths 
plays a fundamental role in the zero-noise-limit theory. 

In "real life" , however, the noise intensity is always 
finite. Calculations of p{x) at finite noise intensity, that 
allow for a direct comparison with an experiment, require 
analysis of the all-important prefactor. Such analysis has 
recently been initiated in a number of publications 
M- HD dealing with the closely related problem of noise- 
induced escape over an unstable limit cycle. 

The research has shown that one has "to leave room 
for the possibility that, even for small noise strengths e, 
more than one " op timal path contributes significantly to 
the escape ^J. However, this plausible assumption 
contradicts the fundamental properties of the pattern of 
optimal paths including the existence of the singulari- 
ties and generic uniq ueness of the most probable escape 
path (see e.g. 0, El 03)- 

This inconsistency does not 
allow the use of the methods of 0, 0, [ljj to compute 
noise-induced variations of the non-equilibrium distribu- 
tion in the whole of phase space. As mentioned in ^3 
the problem is "intricate" due to the subtle properties of 
the pattern of optimal paths near the basin boundary. 

In this Letter, the p(x) is calculated over the whole of 
phase space as a function of noise intensity. Specifically, 



we address the intricate problem of the noise-induced 
changes in the pattern of optimal paths near the sin- 
gularities and show that noise-induced variations of p(x) 
are related to the shift of the singularities and of the 
most probable escape paths. The theoretical predictions 
are verified by Monte Carlo simulations and the numeri- 
cal integration of the Fokker-Planck equation (FPE) . In 
the boundary region we find the position of singularities 
analytically, and provide a more accurate calculation of 
the oscillating probabilit y d istribution discussed in the 
recent publications pi I^Hof. and suggest an intuitively 
clear physical picture of these oscillations. 

To see why the computation of the prefactor calls for 
the analysis of the noise-induced topological changes in 
the pattern of optimal paths, let us consider a Langevin 
equation of the form 

±i = Ki{x) + Veofc&CO i,j = 1, 2. (2) 

Here x% are coordinates of a 2-dimensional dissipative sys- 
tem, £j (t) are Gaussian zero-mean uncorrelated sources 
of noise linearly mixed by a given noise matrix cry, and 
e is a small parameter of the theory. 

The evolution of the probability density p(x 1 1) for the 
system is described by the FPE 

where Q = o~ T o~ is a positively defined diffusion matrix. 

To the leading order of approximation in e, S satis- 
fies 0,0 a Hamilton- Jacobi equation for a classical action 
in the form H(x,VS) — 0, where H(x,p) is the Hamil- 
tonian function equals ^QijPiPj + Ki(x)pi. The pattern 
of extreme trajectories emanating from the stationary 
state of the system is found by integrating Hamil- 
tonian equations with appropriate initial conditions (see 
e -g- 0)j an d the action is found as an integral along 
these trajectories 

±i = Ki + QijPj, pi = --fa-Ph S = ^QijPiPj- (4) 

In general more than one trajectory can arrive at the 
same point x |l2j| . but in the limit of e — * the only 
trajectories contributing to the p(x) are those that pro- 
vide the global minimum of the action and form the pat- 
tern of optimal paths. As a result of global minimization 



FIG. 1: The part of the pattern of optimal paths between 
the unstable and one of the stable limit cycles of a PDOD 
(A = 0.1, n = 2tt) (a) for e = and (b) for e = 0.015. 
The stable x s (t) and unstable x u (t) limit cycles are shown by 
solid lines at the bottom and the top of the figure correspond- 
ingly. The empty region inside the circle is the "breakdown 
region" described in the text. The MPEP and the switching 
line are indicated by dashed lines. 



the state space of 2-dimensional system (j2J is separated 
by so-called switching lines into areas to which the sys- 
tem arrives along optimal paths of topologically different 
types |l2|. In particular, the escape from a metastable 
state of the system (j2J in the e — * limit is governed by 
the properties of the so-called most probable escape path 
(MPEP) that emanates (at t — > — oo) from a station- 
ary state of J2J) and arrives (at t — > +oo) at the bound- 
ary of its basin of attraction. The pattern of optimal 
paths, switching line, and the most probable escape paths 
are shown in Fig. [Ja) f° r a periodically driven over- 
damped motion in a bistable Duffing (PDOD) system: 
Ki = .T-a; 3 +Asin(m), K 2 = = 2tt/T, ct„ = v^ii^i 
(x\ = x and X2 — Ot). 

The pattern is periodic in time and the behavior of the 
switching line and of the MPEP near the basin boundary 
is described by the scaling properties of the solution of 
the linearized Hamiltonian equations (c.f. pi Ifl ITol IT^I 
in a Poincare section (see Fig. |2J in the form 
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where y n — x(t) — x u (t) is the distance to the limit cycle 
at time t = to + nT, a — e~ XT , A 



and Wo = (1 - a 2 ) 1 2 f* +T a 2 {t', t)dt' 
derivative of the action in the x direction (Wq = d y d y S 
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FIG. 2: (a) A section of the lagrangian manifolds. Mu is 
shown by the dashed line. My" is a set of horizontal lines. 
Physically observable part of the Mi formed by the opti- 
mal paths is shown by the thick segments for e = and by 
dashed segments for e / 0. The MPEP is shown by dots 
at the intersection of the two manifolds. The switching line 
is shown by the open circles for e = and by squares for 
e / 0. (b) A section of the non-equilibrium potential (solid 
line). The MPEP is shown by dots where S(y) touches the 
parabola (dashed line) . The switching line corresponds to the 
points of singularities of S(y) (open circles). The section of 
the modified action surface S — e In z is shown by dotted line 
and shifted switching line (for e 7^ 0) is shown by squares. 

The first term in the RHS equation (JSJ) describes the 
divergence of the zero-momentum trajectory from x u (t) 
corresponding to the motion on the unstable manifold 
of this cycle M u . The second term corresponds to the 
motion on the stable manifold Mu ^ of x u (t) with non- 
zero momentum. We note that the initial position of the 
most probable escape path — x (to) — x u (to) is the 
only global parameter of the linear problem. It defines 

the intersection of M u and the unstable manifold of the 
stable limit cycle Ms (see Fig. |2Ja)) . The latter is a 

set of horizontal lines. The physically observable part of 

(u) 

A4 S formed by the optimal paths is a set of segments 
(see Fig. |5Ja)) limited by the switching line. 

The position of the switching line is found by noting 
that the cross-section of the action S(y), as a function 

linear ap - 

where S esc is an escape action in zero-noise limit. The 
MPEP corresponds to the points where S(y) touches the 
parabola. The switching line corresponds to the points 
of singularities of S(y). 

It follows from this geometrical picture that at e = 0: 
(i) MPEP is the only optimal path that approaches the 



of the distance y from the cycle, is a piecewise linear a~ 
proximation of an ideal parabola S esc — \y 2 Wo 
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unstable limit cycle at t — ► oo, (ii) the position of the 
switching line scales as y^ — (a + l)j/Qa n /2 and (hi) the 
switching line also approaches the unstable limit cycle at 
t — > oo in agreement with the qualitative picture shown 
in Fig. 1(a). A similar picture can be obtained for the 
inverted van der Pol oscillator (see ^J](b)) an d is generic 
for 2D systems with unstable limit cycles. 

In the presence of the finite noise intensity, this picture 
breaks down. As we have mentioned above, one has to 
assume that, even for small noise intensity, more than one 
trajectory contributes significantly to the probability of 
crossing the boundary . The choice of a right set of tra- 
jectories that cross the boundary is a subtle problem 
owing to the fact Q that extreme trajectories intersect 
one another wildly near the unstable limit cycle. For ex- 
ample, in |8( a contribution to the escape from all the 
trajectories that emanate from the steady state is esti- 
mated analytically. In 0, it was suggested that the 
main contribution to the escape comes from an infinite 
discrete set of trajectories that are small perturbations of 
the MPEP, which is found numerically. Neither of these 
choices is consistent with the existence of the switching 
line, and the methods of @, 0, cannot be applied 
to compute noise-induced variation of the p(x) over the 
whole of phase space (cf. [Til]). 

We therefore suggest that, to analyze the distribution 
in the whole phase space, it is necessary to investigate the 
noise-induced changes in the pattern of optimal paths. 
Such an analysis can be conveniently performed in the 
next-to-leading order of approximation in e of the solu- 
tion of the FPE, yielding jfj an equation for the prefactor 
in and for the Hessian matrix Sij = didjS [l5j 

^ = -z(d i K i + ^Q ij S i X (7) 

S jm^i^-m SjjnSikQkm- (8) 

The second derivative of the action vanishes rapidly 
near x u (t) on M. s u \ corresponding to the fact that M s u ^ 
is a set of horizontal lines near x u (t). Therefore (for 
the PDOD) the noise induced correction to the action 
— eln(z(t)) over one period can be estimated as eXT. As 
a result, a straightforward application of the equations 
®, 0, © leads to a discontinuity in the probability 
distribution at the position of the switching line of size 
eXT. 

This discontinuity is unphysical. It can be removed if 
one defines the position of a generalized switching line 
as a set of points: z\ ■ exp(— Si/e) = Z2 ■ exp(— S^/e) for 
which probabilities of arrival along topologically different 
optimal paths are equal. We note that this is a natu- 
ral generalization of the original definition [l2T ] and the 
latter is recovered when e goes to zero. It has physical sig- 
nificance of being the locus of experimentally observable 
points where the curvature of the probability distribution 
undergoes sharp qualitative changes (cf. [lg). The noise- 
induced changes in the physically observable part of the 



Ms and in the — elnp(cc) are shown in Fig. [21 Note the 
overall shift of the — elnp(x) due to the prefactor, and a 
stepwise shifts of the linear segments by eXT without the 
change of their slope. The geometrical analysis of these 
changes gives the position of the modified switching line 
in the form y* = (a+ l)y n /2 - eTW /((l - a)y n ). 

The change in the position of the switching line 
has profound consequences for the analysis of the non- 
equilibrium distribution and the escape problem for the 
finite noise intensities. Firstly, p(x,t) calculated in the 
next to the leading order of WKB approximation is now 
continuous everywhere in phase space. Secondly, the 
modified switching line has to shift "up" (compare Fig.Q] 
and Fig-EJ ; and for the linear regime it crosses the bound- 
ary at the point where the distance from the original 
MPEP to the boundary is y { n cr) = v / 2eTW /(l - a 2 ). 
Since the new switching line crosses the boundary, in- 
finitely many optimal paths can now cross the bound- 
ary. Moreover, the original MPEP ceases to be the most 
probable escape path for a finite noise intensity, since it is 
now "cut off" by the intersection with the new switching 
line. Its role is taken by a different path that crosses the 
boundary. Furthermore, the dominant contribution to 
the escape from a metastable state is now governed by the 
continuous set of trajectories which arrive to the bound- 
ary through a "corridor" between the modified switching 
line and the original MPEP. The modified pattern of op- 
timal paths, including the modified MPEP and the modi- 
fied switching line, are shown in Fig.^b). For small noise 
intensities, the set of optimal trajectories that cross the 
boundary can be treated as small perturbations of the 
original MPEP. 

We note that the values of the prefactor z and the Hes- 
sian computed along the paths diverge as a trajectory 
approaches a caustic. The approximation 0, JHJ breaks 
down here, and the method described in this paper can- 
not be applied. The size of the breakdown region scales 
as 0(e 2 / 3 ) near caustic and as 0(e 3 / 4 ) near cusp (see 
e -g- U3[I3li3 ) Near the singularities p(x) can be cal- 
culated using the Maslov-WKB approximation (see e.g. 
[l2T HEI p. The results of these calculations should merge 
in the "far filed" the approximation found by the method 
described above. However, in practice, when calculating 
S — eln(z) using eqs. (@J, 0, ||HJ|, the problem of diver- 
gence can be avoided by partitioning the state space into 
boxes with the size that scales as e 2 / 3 and by assigning 
to each box the probability which is maximized over the 
set of trajectories that pass through this box. 

To verify theoretical predictions we have performed 
Monte Carlo simulations and numerical integration of 
the FPE for two model systems: the PDOD and the 
inverted van der Pol oscillator Ki = x%, K2 = —Xi — 
277x2 (l — x\), Oij — y/4rj8i25j2- Qualitatively similar 
behavior was obtained for both systems. In Fig. |3[a,b) 
we compare theoretical predictions for the function S — 
e ln(z) with the results of numerical calculations for the 
PDOD in different cross-sections. Both numerical tech- 
niques produce the same results and they are in good 
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FIG. 3: (a) Sections at xi — 4.1 of the — e\np(x) calcu- 
lated (solid lines) for different values of e (from the top to 
the bottom): 0.02, 0.01, 0. The results of the Monte Carlo 
simulations (circles) and solution of the FPE (triangles) for 
e = 0.02 (top) and 0.01 (bottom) are shown for comparison, 
(b) The — e\np(x) calculated (solid lines) along the unsta- 
ble limit cycle x^ u ' for four values of e, from the top to the 
bottom, 0.01, 0.005, 0.001, and are compared with Monte 
Carlo simulations (circles) and numerical solution of the FPE 
(triangles) for e = 0.01 (top) and 0.005 (bottom) respectively. 



quantitative agreement with the theory for a wide range 
of noise intensity. 

The behavior of — ehi(p(x)) at the boundary on the 
metastable state is shown in Fig. 01b) for various values 
of the noise intensity. It can be seen that the amplitude of 



the finite-noise induced oscillations increases with e. The 
maxima of these oscillations correspond to the intersec- 
tion of the boundary with the modified switching line and 
are the nondiffcrcntiability points of the modified action 
surface S — e ln(z). The minima of the distribution corre- 
spond to the intersection of the boundary by the modified 
MPEP, and in the linear regime are shifted with respect 
to the maxima by At w ln[2AT/(l - ag)]/2A. For arbi- 
trary values of parameters the position of the modified 
switching line and MPEP found in simulations coincide 
with those predicted theoretically. As the noise inten- 
sity e decreases, the pattern of optimal paths and the 
modified action approach their zero-noise limits. 

In conclusion, we have shown that the structure of sin- 
gularities of non-equilibrium potential in the zero-noise 
limit can be modified in a self consistent way to include 
the effect of finite noise intensity. As a result, a sim- 
ple numerical scheme can be used to calculate p(x) over 
the whole of phase space in good quantitative agreement 
with the results of simulations and numerical integration 
of the FPE for two systems: inverted van der Pol and 
periodically driven overdamped Duffing oscillators. 

In the boundary layer we find analytically the position 
of the modified switching line and modified MPEP, and 
give an intuitively clear physical interpretation to the os- 
cillations of the probability at the boundary discussed 
in recent publications I n particular, these re- 

sults suggest that the oscillations of the escape rate as 
a function of the noise intensity predicted in [l(| cannot 
be observed. The method suggested in this Letter can 
readily be extended to higher dimensional systems. 
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